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ABSTRACT 

The  effects  of  detection  equipment  integration  time  on 
the  optimal  evasive  trajectory  of  an  isotropic  acoustic 
radiator  are  studied.   The  boundary  cases  of  infinite  and 
zero  integration  time  are  examined.   The  infinite  integra- 
tion time  case  is  formulated  as  a  control  problem  and  a 
maximum  principle  solution  is  obtained.   The  results  consist 
of  advice  as  to  the  choice  of  control  vectors.   The  zero 
integration  time  problem  is  formulated  in  ordinary  differ- 
ential equations  and  the  results  consist  of  control  vector 
advice.   The  relative  movement  plots  and  control  vectors  of 
the  two  bounding  cases  are  compared. 
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1.0   INTRODUCTION 

1.1  THE  PROBLEM  UNDER  CONSIDERATION 

It  is  the  nature  of  submarine  warfare  to  avoid  detec- 
tion.  Indeed,  one  of  the  major  advantages  of  the  submarine 
is  surprise.   The  passive  detection  of  low  level  acoustic 
signals  (in  a  water  environment)  is  a  function  of  many- 
factors.   Among  these  are  the  power  density  of  the  signal 
at  the  detector  and  the  period  of  time  over  which  the  signal 
is  received.   This  paper  seeks  to  examine  the  differences 
in  suggested  evasion  tactics  which  result  from  a  study  of 
these  two  factors. 

The  power  density  received  by  the  detector  may  be 
represented  as  shown  in  Figure  1.1.1. 
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Figure  1.1.1 


Due  to  the  nature  of  the  detection  equipment,  a  memory, 
or  integration  time  is  required.   The  integration  time  is 
shown  as  T  in  the  figure.   For  an  evader,  which  is  producing 
the  noise  signal  and  wishes  to  minimize  the  probability  of 
detection  (all  other  factors  being  held  constant) ,  the 
objective  is  to  minimize  the  maximum  area  over  time  under 
the  power  density  curve  over  the  integration  time.   The 
memory  requirement  of  the  equipment  is  the  same  for  each 
instant  of  time.   While  time  advances  this  "window"  of 
integration  time,  T,  slides  along  with  the  power  density 
curve.   Expressed  mathematically  the  objective  is  to: 


Min    Max  /     P(u)   du 


A  solution  in  the  general  case  is  not  proposed,  only  very 
large  and  very  small  values  of  T  will  be  examined.   That  is, 
the  extreme  effects  of  integration  time  on  the  optimal 
evasive  trajectory  are  studied. 

Typically  for  an  evader  at  60  miles  range  initially 
and  a  relative  closing  velocity  of  20  knots  an  engagement 
with  a  searcher  will  be  approximately  three  hours. 


Integration  times  of  less  than  an  hour  are  available  with 
today's  equipment.   As  an  upper  bound  the  case  where  the 
integration  time  is  much  greater  than  the  engagement  time 
may  essentially  be  called  infinite.   The  lower  bound  would 
be  zero.   The  boundary  cases  are  then  "infinite"  and  "zero" 
integration  time.   The  goal  is  to  solve  for  the  two  optimal 
evasive  trajectories  and  to  compare  them. 

The  infinite  integration  time  problem  can  be  formulated 
to  fit  within  the  general  framework  of  the  control  problem. 
This  class  of  problems  is  an  outgrowth  of  the  calculus  of 
variations.   It  is  one  objective  of  this  paper  to  apply  the 
maximum  principle  to  the  infinite  integration  time  problem. 
As  the  integration  time  reduces  to  zero,  the  objective 
becomes  to  minimize  the  peak  power.   This  problem  is 
formulated  in  ordinary  differential  equations. 
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1.2  NOISE  POWER  RADIATION  AND  ATTENUATION 

The  noise  power  radiation,  for  a  line  spectrum  of  a 
submarine  has  been  modeled  to  have  the  mathematical  form 


P(v)  =  a  +  b  v4  (1.2.1) 


where;  a,  b  are  constant  coefficients  to  be  determined, 
and  v  is  velocity,  measured  in  knots. 

Data  was  obtained  on  the  radiated  noise  levels  of 
submarines  as  a  function  of  velocity  at  a  particular  line 
frequency.   A  least  squares  curve  fit  was  made  to  the  data. 
The  form  of  equation  (1.2.1)  was  used.   A  correlation 
coefficient,  R  ,  greater  than  .9  was  obtained.   This  was 
considered  sufficient  justification  for  the  use  of  equation 
(1.2.1)  as  a  model.   The  power  equation  was  then  normalized 
to  the  form, 

P(v)  =  1.0  +  b/a  v4.  (1.2.2) 

The  original  data  used  for  the  development  of  the  coeffi- 
cients is  classified.   Since  the  units  in  which  power  is 
is  measured  are  unimportant  as  far  as  the  analysis  is  con- 
cerned, and  so  that  this  paper  could  be  unclassified,  the 
coefficients  were  normalized.   The  final  form  of  the  power 
equation  used  was, 
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P(v)  -  1.0  +  0.00005  v4.       (1.2.3) 


A  further  assumption  is  that  the  submarine  is  an  iso- 
tropic radiator.   That  is,  the  effects  of  lobe  radiation 
are  not  considered.   The  attenuation  of  the  noise  power  is 
also  assumed  to  follow  an  inverse  square  law.   This  was 
strictly  for  convenience,  since  the  solution  can  easily 
accomodate  any  attenuation  function  as  long  as  it  is  a 
function  of  range.   The  simplifying  assumption  about  iso- 
tropic radiation  is  more  serious,  and  as  yet,  no  manner  of 
incorporation  into  the  proposed  solution  has  been  discovered 
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1.3  HYPOTHETICAL  SUBMARINE  ENCOUNTER 

Suppose  submarine  E,  the  evader,  is  assigned  a  patrol 
area  in  which  she  is  motivated  to  remain,  but  may  maneuver 
at  any  course  and  speed  she  chooses.   Suppose  further  that 
submarine  S  is  searching  along  a  straight  path  with  a 
constant  search  velocity  Vs  for  E.   Assume  also  that  E  is 
directly  on  the  search  path  of  S  as  in  Figure  1.3.1. 


Figure  1.3.1 

In  order  to  attempt  to  avoid  detection,  E  must  detect 
S  and  then  move  away.   The  situation  where  E  detects  S  first 
is  only  considered  here.   Once  S  detects  E,  the  game  is  over 
The  hope  is  that  E  will  know  about  the  presence  of  S,  and 
will  be  able  to  maneuver  in  such  a  manner  that  minimizes 
her  probability  of  detection.   The  evader  is  not  constrained 
in  this  problem  by  acceleration,  and  may  therefore  take  on 
any  initial  velocity  desired.   The  question  is  then,  what 
is  the  optimal  trajectory  which  minimizes  the  probability 
of  detection? 


13 


The  nature  of  the  solution  to  this  problem  gives  the 
answer  to  a  set  of  possible  initial  evasion  states.   It 
is  not  necessary  that  the  evader  start  from  a  point  directly 
on  the  path  of  the  searcher.   Evasion  may  begin  at  any  state 
position. 


14 


2.0   PROBLEM  FORMULATION 

2.1   INFINITE  INTEGRATION  TIME  FORMULATION 

As  an  extreme  the  integration  time  of  the  searcher's 
equipment  could  be  infinity.   That  is,  for  this  situation 
the  objective  of  the  evader  would  be  to  minimize  total  noise 
energy  received  by  the  searcher  over  time.   The  total  energy 
received  by  the  searcher  can  be  expressed  as  an  integral: 

/CO 
Power  received  (t)   dt. 

°  (2.1.1) 

The  power  received  by  the  searcher  is  a  function  of  the 

evader's  velocity  and  distance.   Assuming  an  inverse  square 

law, 

Power  Received  =   2   •        (2.1.2) 
R 

The  problem  may  now  be  expressed  as, 


-CO 


Min  J=   /   ^rp-  dt   ,  (2.1.3) 


J  R 

o 


where  v  and  R  are  both  functions  of  time. 
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This  class  of  problems,  which  results  from  the  calculus 
of  variations,  may  be  solved  by  one  of  two  modern  approaches 
to  the  control  problem.   (2) 

Older  methods  of  static  optimization  involved  the  intro- 
duction of  Lagrange  multipliers,  one  for  each  constraint; 
defining  a  Lagrangian  expression  and  finding  a  saddle  point 
of  this  expression. 

One  modern  approach  to  the  control  problem  is  dynamic 
programing  and  the  application  of  the  principle  of  optimality, 
which  states  that: 

"An  optimal  policy  has  the  property  that,  whatever 
the  initial  state  and  decision  are,  the  remaining 
decisions  must  constitute  an  optimal  policy  with 
regard  to  the  state  resulting  from  the  first 
decision."   (3) 

The  dynamic  programming  approach  basically  assumes  an 
optimal  performance  function  exists  and  defines  a  recurrance 
relationship.   The  partial  derivative  of  this  recurrance 
relationship  is  called  Bellman's  equation,  the  solution 
being  the  optimal  performance  function  sought. 

Another  modern  approach  is  the  maximum  principle.   (2) 
The  maximum  principle  can  be  considered  as  an  extension  of 
the  method  of  Lagrange  multipliers  to  dynamic  optimization 
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problems.   The  general  control  problem  to  be  solved  by  the 
maximum  principle  is; 

Max  J  =  J        I(x,u,t)  dt  +  F(x1,t1) 


subject  to:   ^2S  =  f(x,u,t) 
dt 


x(tQ)  =xQ 


(2.1.4) 


x(tx)  =x1 

[u(t)]eu 

where  I(  ),  F(  ),  and  f(  )  are  continuously  dif ferentiable 
functions;  tQ,XQ  are  parameters  defining  the  terminal  sur- 
face; and   u(t)|  ,  the  control  trajectory  must  belong  to 
the  given  control  set  U. 

In  control  theory  there  are  state  variables,  control 
variables,  and  costate  variables.   In  this  problem  the  state 
variables,  here  represented  by  x  are  actually  the  x  and  y 
position  coordinates,  in  relative  space.   The  variables 
under  "control"  are  here  represented  by  u,  but  in  the 
actual  problem  are  velocity  (v)  and  heading  (0)  .   Velocity 
and  course  heading  are  both  functions  of  time. 
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For  each  constraint  a  "costate"  variable  is  introduced 
This  costate  variable,  A(t),  is  the  dynamic  equivalent  of 
a  Lagrange  multiplier.   This  leads  to  the  development  of 
the  Hamilitonian  function  which  is  defined  to  be; 

H(x,u,t)   =  I(x,u,t)  +   f(x,u,t).     (2.1.5) 

The  infinite  integration  time  problem  may  now  be  expressed 

as; 

06 

Max  J  =      I  P<V>     dt 

J    x2  +  y2 

dx 


subject  to;   ^  =  -Vg  +  v  sin  0 

iX  =  v  cos  0 
dt 

x(t0) 
x(tx) 

y(tx) 


(2.1.6) 


initial  conditions 


terminal  conditions 


where,  0  is  a  function  of  time  and  is  the  course  heading, 
and  v,  also  a  function  of  time,  is  the  velocity.   In  order 
to  achieve  a  practical  mathematical  solution,  infinity  is 
approximated  with  a  large  number. 
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The  constraints   dx/dt  and  dy/dt   are  obtained   from  the 
geometry  of  Figure   3.1.1.      Note   that   the  course  heading,  0  , 
is  measured   from  the  vertical. 


TERMINAL  STATE 


jxCt^yCtp] 


EVADER'S 
TRAJECTORY 


[x(t0),y(t0)] 
INITIAL  STATE 


>x 


Figure  2.1.1  -  geometry  relative  to  the  searcher 


In  this  problem  the  correspondence  of  functions  is; 


K  ) 


P(v) 


x2  +  y2 


(2.1.7) 


F(   ) 


J£m   "  Vs  +v  sin0 


(2.1.8) 
(2.1.9) 
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^  =  v  cos  0  (2.1.10) 

The  solution  to  this  problem  is  contained  in  appendix  A. 

Just  as  the  Lagrange  multipliers  of  static  problems 
yield  information  on  the  sensitivity  of  the  solution,  the 
costate  variables  of  the  maximum  principle  yield  information 
on  the  sensitivity  of  the  solution  to  variations  in  para- 
meters. 

Let  J*  be  the  optimal  value  of  the  objective  function 
then 

-§Sv  =   A* (to)  •  (2-1-11) 

That  is,  the  sensitivity  of  the  optimal  objective  function 
to  changes  in  the  initial  state  variables  is  given  by  the 
corresponding  initial  costate  variables.   If  a  costate 
variable  is  small  then  the  relative  sensitivity  of  the 
optimal  objective  function  will  be  small  for  small  changes 
of  the  initial  state  variable. 

In  static  problems  the  Lagrange  multipliers  have  the 
interpretation  of  "shadow  price"  and  a  dynamic  analogue 
exists. 
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2.1   ZERO  INTEGRATION  TIME  FORMULATION  AND  SOLUTION 

As  the  integration  time  is  reduced  to  zero,  it  can  be 
argued  that  the  objective  of  the  evader  is  to  minimize  the 
peak  power  received  by  the  searcher.   The  problem  may  be 
viewed  as  one  in  which  there  exists  a  threshold  of  power 
density  level,  which,  if  exceeded,  would  result  in  detection 
by  the  searcher. 

Assume  there  exists  a  set  of  state  positions  S  where, 
for  a  given  threshold  of  detection,  the  evader  could  not 
escape.   Assume  also  there  is  another  set  S  where  the  evader 
could  always  escape.   The  sets  could  take  the  form  shown  in 
Figure  2.2.1. 


y  A 


S 

escape 

not  possible 


S 

escape 

always  possible 


Figure  2.2.1 

There  must  exist  some  boundary  between  the  two  sets  of  stati 
positions.   It  would  be  of  interest  to  know  the  general 
shape  of  this  boundary. 
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Suppose  the  evader  is  in  some  state  as  shown  in  Figure 
2.2.2.  For  a  given  power  density  threshold  K  there  will  be 
associated  a  corresponding  velocity  v^  that  satisfies, 

2+2   =  K  (2.2.1) 

x^  +  yz 

where  v^  is  the  maximum  velocity  the  evader  can  have  without 
exceeding  the  threshold  of  detection.   Actually  the  evader 
is  allowed  to  choose  any  velocity  and  heading  within  the 
circle  of  Figure  2.2.2. 


(x,y) 

state  position 


Figure  2.2.2 

The  maximum  velocity  possible  and  the  state  position  deter- 
mine the  angle  0^.   That  is, 

9k  =  arc  sin  (vk/Vg)  (2.2.2) 

By  geometry  (D   =  0k.   The  question  the  evader  must  answer  is, 
which  controls  should  be  chosen. 
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Suppose  the  evader  is  in  set  S,  the  set  of  states  where 
he  cannot  escape  detection  no  matter  which  controls  are 
chosen.   In  Figure  2.2.3  it  can  be  seen  that  the  shape  of 
the  boundary  must  be  such  that  its  slope  at  the  state 
position  is  greater  than  or  equal  to  0^. 

y  A 


Oi 


s 


->  x 


Figure  2.2.3  -  boundary  with  slope <  0^ 

If  the  slope  of  the  boundary  were  less  than  0^  it  would  be 
possible  for  the  evader  to  escape  from  the  set  S.   This 
would  be  a  contradiction. 

Suppose  the  evader  is  in  the  set  of  states  where  he 
can  always  escape,  provided  he  chooses  the  right  control. 
Since  the  evader  is  not  allowed  to  choose  a  control  which 
produces  a  0  greater  than  0n  ,  the  slope  of  the  boundary 
must  be  less  than  or  equal  to  0^.   Otherwise  E  would  always 
move  from  the  region  of  escape  to  non-escape  as  shown  in 
Figure  2.2.4. 
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y  A 


\ 


>  x 


Figure  2.2.4  -  boundary  with  slope  greater  than  0^ 

In  order  to  resolve  these  contradictions,  the  evader 
should  choose  the  controls  which  produce  a  0^  which  is 
tangent  to  the  boundary.   This  is  shown  in  Figure  2.2.5. 

y  A 


■>  x 


Figure  2.2.5  -  boundary  with  slope  equal  to  0^. 

As  shown  by  Figure  2.2.2  this  0^  is  the  result  of  choosing 
the  maximum  velocity  v^. 

Since  the  choice  of  a  velocity  control  will  be  always 
to  maximize  velocity  for  a  given  power  level  which  means  to 
always  produce  as  much  power  as  possible,  the  result  is  that 
the  power  level  will  remain  constant  at  the  detector. 
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For  the  zero  integration  time  situation  the  objective 
is  to  maintain  a  constant  power  level  received  by  the 
searcher.   This  may  be  expressed  as 

P(vf) 


PFINAL  = 


2     2 


=  K 


(2.2.3) 


where  K  is  a  constant,  and  the  f  subscript  indicates  the 
final  value  at  the  termination  of  the  trajectory. 

The  equations  of  motion  may  now  be  derived  from  the 
geometry  as  shown  in  Figure  2.2.6. 

y  A 


0 


Figure  2.2.6 

Velocity,  v,  and  heading,  (7)  ,  are  functions  of  time.   The 
equations  of  motion  are; 


f*  =   -  Vs  +v  sin0 


(2.2.4) 


dy. 

dt 


V  cos 


0 


(2.2.5) 
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Equations  (2.2.4)  and  (2.2.5)  may  be  combined  to  express 


dy         v  cos  0 
dx      -  Vg  +  v  sin  0 


(2.2.6) 


The  problem  now  arises  that  the  initial  conditions 
which  would  allow  a  solution  to  the  equations  of  motion  are 
part  of  the  results  that  are  sought.   One  question  that  the 
evader  would  have,  is  what  initial  velocity  and  heading 
should  be  chosen.   Further  analysis  of  the  nature  of  the 
trajectory  should  supply  a  solution. 

The  following  remarks  refer  to  Figure  2.2.7. 


Figure  2.2.7 

Suppose  the  evader  is  in  state  (xQ,yQ)  and  has  a  given 
power  level,  K.   This  implies  that  vk(0)  is  greater  than 
zero,  where  vk(0)  is  the  velocity  at  state  (x0,yQ).   There 
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will  be  associated  with  this  power  level,  K,  a  trajectory, 
not  necessarily  optimal. 

Suppose  the  final  velocity  at  x=0  is  greater  than  zero. 
The  game  is  considered  over  at  x=0  since  this  would  be  the 
minimum  range,  and  hence,  the  evader  could  simply  stop  all 
action  and  continue  to  improve  his  situation.   It  is  con- 
tended that  there  exists  a  K'  less  than  K,  since  a  v^i(O) 
could  be  chosen  which  is  less  than  v^(0) .   This  would  imply 
that 

P  (vk,(0))    <     P  (vk(0))      (2  2  ?) 


xo2  +  yo2  xo2  +  y02 


Since  v,  f(0)   vi<.(0) >  this  implies  that  0^i<C0,  .   Initially, 
at  least,  the  K1  trajectory  will  lie  below  the  K  trajectory. 
Could  K'  cross  K  as  indicated  in  the  figure?   If  this  were 
to  occur,  the  0^i  would  be  greater  than  0^,  which  would  imply 
that  K1  is  greater  than  K.   This  is  a  contradiction,  and 
therefore,  the  trajectory  for  power  level  K'  cannot  cross 
that  for  K,  but  must  lie  below  it. 

Since  trajectory  K1  is  below  that  for  K,  the  terminating 
distance  yfi  must  be  less  than  yf.   From  equation  (2.2.3)  the 
conclusion  is  that  vfi  must  be  less  than  vf.   That  is,  the 
terminal  velocity  must  decrease.   The  result  then  is  to 
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choose  a  lower  power  level  until  the  terminal  velocity  is 
zero. 

Could  the  terminal  velocity  go  to  zero  before  reaching 
the  y  axis?   This  is  not  a  feasible  result,  since  this  is 
not  the  state  position  of  minimum  range.   Due  to  the  move- 
ment of  the  searcher  the  range  would  decrease  and  the  power 
received  would  increase  above  the  detection  threshold. 

The  object  was  to  discover  the  initial  conditions  so 
the  equations  of  motion  could  be  solved.   Instead  the 
termination  conditions  are  known.   These  will  be  used  as 
initial  conditions  by  reversing  time.   The  system  of  equa- 
tions to  be  solved  is  now; 

4^  =  V   -  v  sin  (h  (2.2.8) 

dt    s         ' 


and, 


&   =  -  v  cos0  (2.2.9) 


x(tQ)  =  0 


y(t0)  =  parameter 

v(t0)  =  0 
0(to)  =  0 

are  the  initial  conditions. 
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3.0  RESULTS 

The  results  of  the  analysis  consist  of  giving  advice 
on  the  choice  of  control  variables  to  an  evader.   Both 
cases  are  presented;  infinite  integration  time  in  graph 
(l.A.)   and  zero  integration  time  in  graph  (l.B.)    Advice 
is  given  in  both  cases  only  for  the  first  quadrant,  as  this 
is  the  region  of  greatest  concern.   Four  evasive  trajectories 
were  calculated  and  are  shown  on  each  graph.   Those  trajec- 
tories considered  were  for  initial  evasion  ranges  of  60, 
40,  30,  and  20  miles.   Trajectories  were  calculated  for 
each  of  the  four  initial  ranges  both  for  infinite  and  zero 
integration  time.   The  set  of  graphs  labeled  2.--  are  for 
a  search  velocity  of  15  knots.   Set  3.--  is  a  replication 
of  set  2.--  but  for  a  search  velocity  of  10  knots. 

For  the  10  knot  search  velocity  and  infinite  integra- 
tion time  trajectories  were  calculated  for  initial  evasion 
ranges  of  30  and  20  miles.  The  60  and  40  mile  curves  went 
off  scale  and  were  omitted. 

Control  variable  measurements  were  taken  from  the 
velocity  and  heading  graphs  and  these  control  vectors  were 
plotted  on  the  relative  movement  plots  in  graphs  l.A  and 
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l.B.   These  vectors  are  the  advice  which  would  be  given  to 
an  evader.   It  is  not  necessary  that  an  evader  start  at  a 
state  position  such  that  he  is  directly  on  the  path  of  the 
searcher.   He  may  start  at  any  position  and  begin  evasion 
with  the  control  vector  belonging  to  that  state.   If  the 
searcher  should  change  speed  it  would  be  necessary  for  the 
evader  to  consult  a  new  set  of  control  variables  and  continue 
the  evasion. 

Graph  l.C  shows  a  comparison  of  the  relative  movement 
plots  of  infinite  and  zero  integration  times.   Only  the  60 
and  30  mile  curves  are  presented  for  clarity.   The  control 
vectors  for  the  two  situations  do  not  appear  significantly 
different  during  the  initial  stages  of  the  trajectories, 
and  the  result  is  similar  trajectories.   As  the  range  de- 
creases the  effects  of  integration  time  become  more  apparent. 
The  graph  shows  that  near  the  minimum  ranges  the  effects  of 
integration  time  are  critical  and  hence  it  would  be  of 
interest  to  know  what  the  integration  time  of  the  detector 
is.   During  the  initial  stages  of  evasion  knowledge  of  the 
integration  time  is  not  critical. 

Graph  l.D  is  a  representative  plot  of  the  costate 
variables.   The  costate  variables,  in  part,  represent  the 
importance  of  their  corresponding  state  variable.   Costate 
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variable  A  t  corresponds  to  the  x  coordinate  and  X  o  to  t*ie 
y  coordinate.   The  graph  shows  that  the  evader,  starting  at 
state  position  (x  =  60,  y  =  0)  wants  to  increase  y  and 
values  y  slightly  over  x.   That  is,  the  evader  values  an 
increase  in  the  lateral  distance,  y  over  an  increase  in 
time.   This  is  true  throughout  the  trajectory. 
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INFINITE  INTEGRATION  TIME 


RELATIVE     MOVEMENT  PLOT 
(WITH  EVADiR"5-   CONTROL  VICTORS) 


SEARCH  VELOCITY-I5.O  KNOTS 


VELOCITY  SCALE-KNOTS 
1     '     '     '     '     1    '     '     '     '     I 

0       10      26 


NOTE:   For  interpolation 
of  control  vectors 

1.  refer  to  graph  2. A. 2 
for  velocity 

2.  refer  to  graph  2. A. 3 
for  heading 


GRAPH  l.A 
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ZERO   INTEGRATION  TIME 


RELATIVE  MOVEMENT  PT.fTT 
(WITH  EVADOR'S   CONTROL   V^CTOR^) 


SEARCH   VELOCITY-  15.0  KNOTS 


10  20  30 

X      COORDINATE    — niLES 


VELOCITY  SCALE— KNOTS 
[    I     I     I     I     |     I     I     I     |     1 


10 


NOTE:   For  interpolation  of 
control  variables: 

1.  refer  to  graph  2.3.2  for  velocity 

2.  refer  to  graph  2.B.3  for  heading 


GRAPH  l.B 
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INFINITE  AND  ZERO 
INTEGRATION  TIME  EVASION  TRAJECTORIES 


SEARCH  VELOCITY-  15.0  KNOTS 


10  20  30 

X      COORDINATE    —MILES 


GRAPH  l.C 
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INFINITE  INTEGRATION  TIME 
COSTATE  VARIABLES  VERSUS  X  COORDINATE 
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GRAPH  l.D 
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INFINITE  INTEGRATION  TIME 
RELATIVE -MOVEMENT  PLOT 
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SEARCH  VELOCITY  =  15.0  KNOTS 
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GRAPH  2.A.1 
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INFINITE  INTEGRATION  TIME 
VELOCITY  VERSUS  X  COORDINATE 


15.0 


12.5 


10.0 


7.5 


5.0 


2.5 


0.0 


The  curves  are  for  the 
initial  state  positions 
shown  in  (   )  . 


SEARCH  VELOCITY  =  15.0  L1T0TS 


X  COORDINATE  --  MILES 


GRAPH  2. A. 2 
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INFINITE  INTEGRATION  TIME 
COURSE  HEADING  VERSUS  X  COORDINATE 


The  curves  are  for  the 
initial  state  positions 
shown  in  (   ) . 
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GRAPH  2. A. 3 


38 


INFINITE  INTEGRATION  TIME 

POWER  DENSITY  RECEIVED  BY  SEARCHER 
VERSUS  X  COORDINATE 


The  curves  are  for  initial 
state  positions  shown  in 
(   ). 
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GRAPH  2. A. 4 
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ZERO  INTEGRATION  TIME 
RELATIVE  MOVEMENT  PLOT 
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GRAPH  2.B.1 


40 


ZERO  INTEGRATION  TIME 
VELOCITY  VERSUS  X  COORDINATE 


The  curves  are  for  the  initial 
state  positions  shown  in  (   ). 
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GRAPH  2.B.2 
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ZERO  INTEGRATION  TIME 
HEADING  VERSUS  X  COORDINATES 


The  curves  are  for  the  initial 
state  positions  shown  in  (   ) . 
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INFINITE  INTEGRATION  TIME 
RELATIVE  MOVEMENT  PLOT 
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NOTE:   Control  variables  may 
be  obtained  from 
Graphs  3. A. 2  and  3. A. 3 


GRAPH  3.A.1 
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INFINITE  INTEGRATION  TIME 
EVASION  VELOCITY  VERSUS  X  COORDINATE 


The  curves  are  for  the  initial 
state  positions  shown  in  (   ) . 
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GRAPH  3. A. 2 
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INFINITE  INTEGRATION  TIME 
COURSE  HEADING  VERSUS  X  COORDINATE 


The  curves  are  for  the  initial 
state  positions  shown  in  (   ) . 
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INFINITE  INTEGRATION  TIME 
POWER  DENSITY  RECEIVED  BY  SEARCHER  VERSUS  X  COORDINATE 


The  curves  are  for  the  initial 
state  positions  shown  in  (   ) . 
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ZERO  INTEGRATION  TIME 
RELATIVE  MOVEMENT  PLOT 
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NOTE:   Control  variables  may  be 

obtained  from  Graphs  3.B.2 
and  3.B.3. 
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ZERO  INTEGRATION  TIME 
VELOCITY  VERSUS  X  COORDINATE 


The  curves  are  for  the  initial 
state  positions  shown  in  (   ) . 


SEARCH  VELOCITY  =10.0  KNOTS 


15.0 


12.5 


10.0 


fc   7  5 


5.0 


2.5 


1 

1 

T     i 

1 

(20t0)          ( 

J0.0)      (4 

0.0) 

1 

(60.:) 

/  '             / 

- 

\     /              /\     yS 

/x^ 

^^ 

- 

*-\ — 1 — 1 — 1 — I — 1 — 1 — 1 — 1 — 

— 1 — 1 — 1 — 1 — 

— 1 — 1 — 1 — 1 — 

T 1 1 1 — 

1      1     1  T 

0.0 

P  10         20         30         40         50         60 

X       COORDINATE    — fllLES 


GRAPH   3.B.2 


48 


ZERO  INTEGRATION  TIME 
COURSE  HEADING  VERSUS  X  COORDINATE 


The  curves  are  for  the  initial 
state  positions  shown  in  (   ) . 
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APPENDIX  A 
SOLUTION  TO  INFINITE  INTEGRATION  TIME  PROBLEM 

The  problem  may  be  stated  as, 


MAX  J  =  /     n  ?(,Vl  dt 

/     x  +  y 

fc0 


subject  to; 


dx 


dl  =  "  Vs  +  v  sin  0 


-=J   =   V  cos  0 
x(tQ)  =  xQ 

y(t0>  =  ^o 

x(tx)  -  xx 

y(tx)  =  yx 

where  P(v)  =  1.  +  0.00005  v*   :   Velocity,  v,  and  course 
heading, 0  ,  are  functions  of  time.   Velocity  is  measured 
in  knots.   The  limits  of  integration  should,  in  theory,  be 
As  stated  t^  ■  0  and  infinity  is  approximated  with  a  large 
number  ti.   The  symbols  are  as  shown  in  Figure  1. 
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y 


(xpy^ 


(x0,y0) 


>  x 


Figure  1 


The  Hamiltonian  function  is  now  defined  as 

H  (x,y,v,0,t)  =  I  (x,y,v,0,t)  +  Af  (x,y,v,0,t) 
In  the  case  under  discussion, 


H(x,y,v,0,t)  =   'x'/iV)y2   +  <^1  <"Vs  +  v  sin0  >  +A2  v  C0S(P 

(1) 

The  object  is  to  maximize  the  Hamiltonian  function  at 
every  point  of  time  along  the  optimal  trajectory  by  choice 
of  the  control  variables,  v  and  0.   It  is  required  that; 


ill-  o 

d  v 

1"  =  o 
2^3 


1       7l  X 


A  =  -  5h 


(2) 


and 


,      A^V  =  o    ,  A2(t1)  -  o 
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Now,    from  (1)    and   (2), 


)  2  x  P(v) 

1  /    2    .      2\2  v    ' 

(x^  +  yz) 


A  2  y  P(v) 

A2=      "        (x2  +  y2)2  (4) 


Also, 

3  H 


9~^  "      -     x2  +   '2       +   Al   sin0    +      A2     cos0       (5) 


~=rpk=      ^1  v  cos  0     -    A2  v   sin0 
Setting   equation    (6)    equal    zero    implies 

Ax 


(6) 


sm 


A 


2  cos  0 


or, 


0     =  tan"1      (A1/A2>      '  <7> 


From   trigonometry   and  Figure    2    it   can  be   seen   that, 

A2 


cos 


*    =       c^+A,2)*  <8) 


and  sin<7)       =     —r— 5 rT"xJ-  (9) 

^  (  Ai2  +    A22  )* 
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Figure   2 


Substitution  of  equations    (8)    and   (9)    into   (5)    results   in; 


P'(v) 


^i2  ±  A22      _  r— — — 

12.)     2<k  VA12  +    A22 


*2  +  y2         (  Ax2  +  X22)k 

Therefore,  P'(v)    =   (x2  +  y2)    "^  AX2     +A22  (10) 


Since  P    (v)    =  1.0  +  0.00005  v    , 

Pf(v)    =  0.0002  v3 


(ID 


Equating  (11)  and  (10)  and  solving  for  v  results  in 


v  =  (5000.  (x2  +  y2)  ^/Ai2  +  A22)  1/3  •    (12) 

Equations  (7)  and  (12)  are  the  conditions  for  optimality, 
and  must  be  satisfied  at  every  point  in  time  along  the 
optimal  trajectory. 
Since  Ai(t-,)  =  X2(^1)    =  0>  from  (i2)  it  follows  that 


v(tx)  =  0 


(13) 
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Since     0(t-.)    =   tan"1     —   1      \\         is    an    indeterminate 
1  A2<ti) 


form  a  solution  is  sought  in  L'Hopital's  rule.   Rewriting  (7), 

Ai<*i: 
A2<V 


tan(^(ti)=  nuo3 


and  applying  L'Hopital's  rule 


^>  X1(t1) 


lim      tan  0  (t]L)  =  |j   .      (14) 

t-*tx  ^  3  A2(ti) 


Substituting  (3)  and  (4)  into  (14)  and  canceling  similar 
terms  results  in 

lim     tan0(t  )  =  -?-   .  (15) 

Rewriting  (15)  the  terminal  condition  for  the  control 
variable  <j)   is 

(ft   (tj)  =  tan"1   -^-   .  (16) 

The  objective  is  to  find  the  values  of  the  control  variables 
at  every  point  in  time.   Of  principle  interest  are  the 
initial  velocity  and  heading.   The  solution  now  involves 
four  simultaneous  partial  differential  equations.   The 
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initial  conditions  of  variables  x  and  y  could  easily  be 
given,  but  only  the  terminal  conditions  are  known  for 
X  -i    and   A  o*   The  solution  is  to  reverse  time  and  call 
the  initial  conditions  terminal  conditions  and  vice  versa, 
Reversing  time  changes  the  signs  of  the  differential  equa- 
tions, but  has  no  effect  on  the  optimal  conditions. 

The  problem  solution  in  backward  time  may  now  be 
stated  as. 


°  =  V   -  v  sin  (h 

X        S  ^ 


v  cos  0 


o  =  2  x  P(v) 
^1  "   (x2  +  y2)2 


o   =   2  y  P(v) 
(x2  +  y2) 


A2 


where  the  "o"  represents  backward  time.   The  initial 
conditions  are; 


x(t  )  =  parameter 

0  >  state  variables 


y(t  )  =  parameter 
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A^to)  =  o 
A2(t0)  =  o 


costate  variables 


v(to)    =  0 


0  (tQ)    =  tan     (x/y) 


control  variables 
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APPENDIX  B 
COMPUTER  OUTPUT  AND  METHODS  OF  SOLUTION 

The  computer  routines  given  in  this  appendix  were  set 
to  operate  on  the  time  sharing  system  (cp/cms)  of  an  IBM 
360  computer.   The  graphical  display  package  of  a  Tektronix 
4012  display  terminal  were  used.   Various  termination  state 
positions  were  attempted  until  an  initial  evasion  range  was 
selected.   Since  all  the  information  for  a  particular 
trajectory  was  calculated  at  each  execution,  it  was  only 
necessary  to  change  the  call  statements  in  the  plotting 
package  for  different  visual  display. 
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FLOW  CHART  FOR  INFINITE  TIME  SOLUTION 


INITIAL  CONDITIONS 


X«=  parameter 
Y=parameter 


:  > 


^> 


STATE 


COSTATE 


v  -  0  \ 

<j>  =  tan'^X/Y), 


'CONTROL 


DIFFERENTIAL  EQUATIONS 


NO 


X=Vs-v  cos  $ 
Y=  -v  sin  5 


X.=  2  X  P(v)/R^ 
A2»  2  Y  P(v)/R^ 


OPTIMAL  CONDITTCNS 


(gives  solution  for  v) 
|-  tan-^X,/^ 


IS  Y  LESS  THAN  0  ? 


T  is  in  hours 
v  is  in  knots 
x,y  are  in  miles 
Vg  is  searchers  speed 
in  knots. 


P(v) 


1+  b 


YES 


STOP 
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